200208277 1 



METHOD AND SYSTEM FOR AUTOMATING WORKFLOWS 
Background of the Invention 

5 

As computer networks become more and more ubiquitous in office 
environments, hand-carrying paper documents within the typical office is being 
replaced by electronic routing of these documents within the office. However, a 
significant number of office processes, such as court document processing and 

10 various hospital procedures, still rely on the use of paper documents. These 
processes may require, for example, a manual signature on a paper contract, a 
physician's written comments, or a physician's signature on a prescription. In 
other examples, paper documents may take the form of preprinted, government- 
required standard forms having areas for manual entry. Where office processes 

15 continue to be based on paper documents, automation of these processes can 
be a daunting task and requires some level of software workflow expertise. 

Brief Description of the Drawings 

20 Figure 1 is a block diagram of a system for automating a workflow 

according to an embodiment of the invention. 

Figure 2 is a block diagram of a multifunction peripheral used in a system 
for automating workflows according to an embodiment of the Invention. 

Figure 3 is a candidate workflow menu presented on a display of a 
25 multifunction peripheral according to an embodiment of the invention. 

Figure 4 is a partial list of tasks from a candidate workflow that has been 
printed and filled out by a person configuring a workflow at a multifunction 
peripheral according to an embodiment of the invention. 

Figure 5 shows a subset of the tasks shown in Figure 4 as well as a scroll 
30 bar suitable for display on a multi-function peripheral or at a workstation 
according to an embodiment of the invention. 
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Figure 6 is a flowchart for a metliod for automating a workflow according 
to an embodiment of the invention. 

Figure 7 is a flowchart for a method for modifying a workflow using a 
multifunction peripheral according to an embodiment of the invention. 

Description of the Embodiments 



Figure 1 is a block diagram of a system for automating a workflow 
according to an embodiment of the invention. The multifunction peripherals 

10 (120, 122, 124) in the system of Figure 1 "learn" the manually performed tasks 
completed at the peripherals and convert these into an automated set of tasks. 
Thereafter, these tasks can be performed using the various multifunction 
peripherals of Figure 1 , thus automating the entire workflow. 

In Figure 1, computing device 100 includes memory 105, processor 107, 

15 and user interface 109. Computing device 100 may be any type of desktop 

computer, laptop computer, or handheld computing device. Further, computing 
device 100 may represent processing resources within a server that performs 
functions in addition to those described herein. Although not shown in Figure 1, 
it is contemplated that computing device 100 includes a display that allows the 

20 user of the computing device to display information that results from processor 
107 operating on data supplied to the processor from memory 105, network 
interface 115, and user interface 109. Additionally, memory 105 is 
contemplated as encompassing a wide variety of memory technologies, such as 
solid-state memories, optical and magnetic disks, as well as other types of 

25 volatile and non-volatile memory technologies. 

Computing device 100 communicates with storage device 110, 
multifunction peripherals 120, 122, and 124 by way of communications network 
125 and network interface 115. Communications network 125 may include 
conductive signal paths, such as those used with Ethernet or Intranet local area 

30 networks that operate within an enterprise. Communications network 125 may 
also include wireless communications capability, such as those compliant with 
IEEE 802.1 1a, b, or g, or other network protocols. 
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Multifunction peripherals 120, 122, and 124 represent a variety of 
peripheral devices that perform functions related to printing paper documents, 
scanning paper documents, or performing both of these functions. Further, one 
or more of the multifunction per'ipherals is contemplated as including a scanning 
5 capability that detects a simple graphic that is present at a particular location on 
the printed document (such as a filled-in circular "bubble", or a square that has 
been filled in). Thus, multifunction peripherals 120, 122, and 124 include 
peripherals that print documents generated by computing device 100, as well as 
scanning documents that can be digitally transmitted in an electronic form along 
10 communications network 125, Multifunction peripherals 120, 122, and 124 are 
also contemplated as being capable of printing documents that represent 
instructions to the user or printing partial results relevant to a particular 
workflow. 

In Figure 1, although only three multifunction peripherals are shown, 

1 5 nothing prevents the use of as few as one or two multifunction peripherals, as 
well as the use of more than three of these peripherals. Further, the 
multifunction peripherals may be located within a single business, such as a 
bank or a title company, or may be located across multiple business entities that 
coordinate their activities to achieve a common objective, such as a mortgage 

20 loan broker, a title company, and a bank that each participate in the process of 
securing a real estate loan. 

In the embodiment of Figure 1, multifunction peripherals 120. 122, and 
124 are used to execute the constituent parts of an automated workflow. One 
example of a paper document-based workflow that can be automated by the 

25 system of Figure 1 is that of a property appraisal that may be obtained in 

connection with securing a residential or a commercial loan. Other examples of 
paper document-based workflows include hospital admissions and discharge 
processes, employment screening, and so forth. Thus, although the 
embodiment of Figure 1 and other figures shown and described herein refer to a 

30 particular application of workflow automation, it is contemplated that a wide 
variety of other workflows may be automated in accordance with embodiments 
of the present invention. 
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In Figure 1, computing device 100 is used to prepare an initial template 
that includes a workflow name, an ordered or unordered list of tasks that 
constitute the general tasks in the workflow to be automated, such as file 
selections that the workflow receives data from and writes data to, and so forth. 
5 The initial template thus represents a selection menu of basic tasks and also 
identifies relevant documents, workstations, multifunction peripherals, and users 
that are relevant to the overall workflow. For example, these tasks may include 
tasks such as "print out document just received", or "print bar code cover sheet". 
These tasks are entered into computing device 100 by way of user interface 

10 109, which may include either one or more of a keyboard, mouse, keypad, 
touchpad, touch screen, and so forth. In Figure 1 , a software wizard program 
may be used to simplify and clarify the relevant information to be collected and 
displayed to the person performing the initial workflow setup. 

After entering the initial template, the initial workflow setup includes 

15 specifying the first station to be involved in the workflow. An information packet 
that represents the workflow template is conveyed along communications 
network 125 to the designated multifunction peripheral, 120. In an embodiment 
of the invention, document 130 is printed using the multifunction peripheral and 
presented to a user. The document includes at least a partial list of the tasks 

20 entered into computing device 100. The user may then decide which tasks 
should be performed using multifunction peripheral 120 as well as select a 
particular ordering of the tasks performed by the multifunction peripheral. 

As shown in Figure 1, document 130 may include the name of the 
particular task, along with two or more columns that allow the user to select 

25 whether the task is to be performed at multifunction peripheral 120. A bubble 
chart may be used to allow the user to indicate the order that the tasks are to be 
performed (such as that described in Figure 4). The tasks identified on 
document 130 may include printing material with the multifunction peripheral, 
scanning material into the multifunction peripheral, electronically sending a 

30 digitized representation of the material, encrypting information representing the 
material, transmitting a facsimile of the material, receiving a facsimile of the 
material, and storing a representation of the material. Document 130 also 
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includes a bar-coded label (or other machine-readable marking) that uniquely 
identifies the name of workflow as well as the state of the workflow at 
multifunction peripheral 120. 

Using document 130, the user manually identifies the tasks to be 
5 performed at multifunction peripheral 120 as well as the ordering in which the 
tasks are performed. When the user has completed entering information into 
document 130, the user may scan document 130 into multifunction peripheral 
120. In the embodiment of Figure 1, multifunction peripheral 120 includes a 
capability to perform some level of image processing that informs the peripheral 
10 which of the tasks listed on document 130 are to be performed using peripheral 
120 based on the user's entries in the columns and the bar-code label printed 
on document 130. Figure 1 shows the bar-coded label in the in the upper-left 
portions of document 130, the label can be placed at any location on the 
document. 

15 In another embodiment of the invention, document 130 includes 

additional columns that identify a multifunction peripheral other than peripheral 
120 as well as identifying the tasks that should be performed at the other 
multifunction peripheral. This allows the use of a single peripheral to identify the 
workflow tasks performed at perhaps all of the multifunction peripherals in the 

20 system. In another embodiment, document 130 is replaced by a touch screen 
display interacting with the user (Figure 5). This process collects similar 
information. 

Returning to the embodiment of Figure 1 , after the user has completed 
scanning document 130 into multifunction peripheral 120, the user may 

25 complete additional interactions with the peripheral by way of user interface 109. 
This may include further refining selections of documents or modifying the next 
destination of the workflow. Then, multifunction peripheral 120 conveys the 
modified task list to multifunction peripheral 122 (or to the designated next 
multifunction peripheral). The peripheral then prints document 132, which 

30 presents a second list of the general task and data descriptions that represent 
possible tasks to be performed at peripheral 122. In a manner that accords with 
the actions performed at peripheral 120, the user modifies document 132 to 
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identify those tasks of the workflow that are to be performed at multifunction 
peripheral 122 as well as the relative ordering of the tasks. Further, document 
132 includes a bar-code label that identifies to peripheral 122 the names and 
the current state of the workflow. The user can then scan document 132 into 
5 multifunction peripheral 122, thereby identifying to the peripheral the tasks that 
are to be performed at peripheral 122. 

In like manner, an updated task list that includes the modifications 
performed at each multifunction peripheral is conveyed serially to the various 
multifunction peripherals within the user's work environment. At each 

1 0 peripheral, the user is able to select which tasks of the workflow are to be 
performed at the particular peripheral and the order in which the tasks are 
performed. In one embodiment of the invention, tasks that cannot be performed 
at a particular multifunction peripheral may be grayed-out or not printed at all. 
For example, if one of the peripherals does not include a facsimile capability, 

15 tasks related to this function may not be presented. The workflow of Figure 1 
ends with task 16 performed at peripheral 124. 

In an example that includes multifunction peripherals that do not possess 
a printing capability, such as a digital transmitter or digital sender, the user may 
exclude printing tasks from being performed at that particular peripheral. In 

20 another example, if a certain task in a workflow includes printing a check using 
Magnetic Ink Character Recognition (MICR) ink, the user may select that this 
task be performed using the multifunction peripheral loaded with the MICR ink. 
Further, if a peripheral that performs a subsequent task does not include a 
scanner that possesses an image processing capability nor includes a user 

25 interface capability, the user may modify the tasks performed at the peripheral 
by way of a previous (or subsequent) peripheral that does possess an 
appropriate user interface. 

In some embodiments, multifunction peripherals may communicate with 
each other as the workflow "learning" progresses in order to streamline the 

30 selections and choices shown at any given station. In addition, the multifunction 
peripherals may communicate with computing device 100 in the event a 
problem occurs during the learning of the workflow or to provide a status 
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update. This can alert the setup administrator in the event that a corrective 
action is required. 

When the user has completed modifying a workflow, the user-modified 
task list that represents the workflow can be stored in memory 105 of computing 
5 device 100. Alternatively, the appropriate portions of the workflow can be stored 
in multifunction peripherals 120, 122, and 124. In this embodiment, the 
individual peripherals store those tasks performed at the respective peripheral. 

In another embodiment, computing device 100 is not present. In such an 
embodiment, storage device 110 may have a preloaded template that includes 

10 the various tasks of the particular workflow. At each of peripherals 120, 122, 
and 124, the user may retrieve the appropriate workflow from storage device 
110, thereby allowing the workflow to be modified at the peripheral. 

Figure 2 is a block diagram of a multifunction peripheral used in a system 
for automating workflows according to an embodiment of the invention. In the 

15 embodiment of Figure 2, multifunction peripheral 120 includes network interface 
210, which provides communications along communications network 125 (of 
Figure 1). Peripheral 120 also includes processor 220, and memory 230. which 
stores a list of the tasks of the workflow. Included also are user interface 240, 
scanner 250, and printer 260. Peripheral 120 includes facsimile device 265 that 

20 allows the user to transmit and receive facsimile copies of printed documents. 

In the embodiment of Figure 2, user interface 240 includes a display that 
presents workflow tasks to the user and accepts inputs from the user, such as 
the touch screen inputs that are used to select the order in which the workflow 
tasks are to be performed. User interface 240 may also include a keypad, 

25 integral or external keyboard or other input device as well as security and 
authentication measures, such as a fingerprint reader that authenticates the 
user by way of the user's finger or thumbprint. User interface 240 may also 
include a badge reader, signature pad, or other identity-verification scheme. 
Processor 220 controls the operations of the peripheral, as well as performing 

30 image-processing functions on paper documents input into the peripheral by 
way of scanner 250. 
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It is contemplated that the multifunction peripheral of Figure 2 is capable 
of performing more than one workflow, such as will be discussed in connection 
with Figure 3. For example, in the event that the peripheral of Figure 2 is 
located in a financial institution, the peripheral may perform a variety of 
5 workflows related to personal savings and checking account management, 

stock transactions, real estate loans, and so forth. Each of these workflows may 
be uniquely identified and may be associated with a particular individual or 
group of individuals employed at the financial institution. Further, each 
instantiation of a particular workflow, such as a real estate loan application for a 

10 specific property, may carry an identifier selected by a particular individual at the 
financial institution. In addition, in the event that two or more individuals have 
selected the same identifier, such as "Benton Heights Development", processor 
220 includes the necessary logic to deconflict one workflow associated with 
employee "A" from a similar workflow associate with employee "B". 

1 5 Figure 3 is a candidate workflow menu presented on a display of a 

multifunction peripheral according to an embodiment of the invention. In Figure 
3, workflow menu 300 is presented after the user named John Smith has 
identified himself to the peripheral. In the left column of workflow menu 300, are 
the titles of the workflows for which John Smith is responsible. These workflows 

20 include the residential property appraisal, industrial property appraisal, and so 
forth. Near the bottom of workflow menu 300, "Add Personal Workflow" allows 
the user (John Smith) to retrieve a workflow or a template for a workflow that is 
not already listed. On the right-hand column of workflow menu 300, workflows 
that perhaps pertain to the department in which John Smith works are also 

25 listed. These workflows include, but are not limited to, "Real Asset Valuation", 
"Auditing", and so forth. At the lower right side of workflow menu 300, the 
display provides the capability to access a template for a workflow that is not 
already displayed. 

Figure 4 is a partial list of tasks from a candidate workflow that has been 

30 printed and filled out by a person configuring a workflow at a multifunction 
peripheral according to an embodiment of the invention. The tasks listed in 
Figure 4 can pertain to any type of general business-related workflow involving 
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various activities tliat include printing documents, validating a signature, 
authenticating a user, filing a document, and so forth. Figure 4 also includes an 
entry to select the ordering of tasks in the event that several tasks need to be 
performed at a particular peripheral. The hardcopy printout of Figure 4 may also 
5 show workflow tasks performed at a previous or subsequent multifunction 
peripheral. As previously mentioned, this allows the user to make additions, 
deletions, and other modifications to tasks performed using other multifunction 
peripherals that perform the workflow. 

In Figure 4, the multifunction peripheral has been placed in a training 

10 mode that allows the user to modify the tasks of the workflow performed at the 
particular peripheral. As previously mentioned, the ability to place the peripheral 
into a mode in which the workflow tasks can be modified, added, or deleted may 
require the authentication of the user to establish that the user is indeed 
authorized to make changes to the workflow. In the context of Figure 4, a user 

15 may wish to move the task "Request user name and password" (task 12) so that 
this task is performed prior to any other. To bring about this modification, the 
user need only fill in the bubble in the "1" column adjacent to the task name to 
indicate that this task is to be performed first. The printed document is then 
scanned into the multifunction peripheral where processor 220 (of Figure 2) 

20 determines the presence of the filled-in bubble and proceeds to the next task in 
the workflow. 

Figure 5 shows a subset of the tasks shown in Figure 4 as well as a scroll 
bar suitable for display on a multi-function peripheral or at a workstation 
according to an embodiment of the invention. The addition of the scroll bar to 

25 the display more closely resembles the manner in which the task list would be 
displayed on a contemporary multifunction peripheral having a smaller-sized 
display. In the example of Figure 5, a touch screen is used to select the order in 
which the tasks are to be performed. Although not shown in the Figure, a 
"reorder" button may be included that functions to display the tasks in the order 

30 in which they are to be performed. 

Figure 5 may also include a selection to append or prepend tasks to the 
current list of tasks being performed at the present multifunction peripheral. 
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Thus, in the event that either a previous or a subsequent multifunction 
peripheral becomes inoperative, the tasks performed by the currently 
inoperative peripheral can be directed to be performed at the present peripheral. 
This can be especially useful in that a particular workflow, which may involve the 
5 use of several peripherals performing the workflow's tasks In a serial fashion, 
can be made fault tolerant such that the loss of a single peripheral need not stall 
the entire workflow. 

Figure 5 further can also include a selection to reorder the displayed 
tasks as required. The rearranged workflow tasks can then be saved and 

10 performed in the rearranged order the next time the workflow is performed. In 
another example, the display of the multifunction peripheral may simply present 
information, such as the document's file name, and solicits an input from the 
user to indicate that the user approves or has verified the correctness of the 
displayed information. 

15 Figure 6 is a flowchart for a method for automating a workflow according 

to an embodiment of the invention. The multifunction peripheral discussed in 
reference to Figure 2 is suitable for performing the method of Figure 6. The 
method begins at step 510, in which infonnation that identifies the name and a 
present state of the workflow at the multifunction peripheral are transmitted to a 

20 multifunction peripheral. At step 520, a list of workflow tasks is presented to the 
user of the multifunction peripheral. The list of tasks may correspond to tasks 
that have been previously performed in the workflow, such as at a previous 
peripheral, or the list may pertain to tasks that have not yet been performed in 
the workflow. Step 520 can include presenting the name or some other 

25 identifier of the workflow and the present state of the workflow. Step 520 may 
include presenting a printed list, in which the user input to the multifunction 
peripheral includes the user marking entries on the printed list, such as is 
described with reference to Figure 1 and 4. 

At step 530, the multifunction peripheral is placed in a workflow training 

30 mode that allows the peripheral to accept changes to the workflow, perhaps 

after authenticating the user by way of the user entering a password, signing on 
a signature pad, placing finger or thumb on a fingerprint reading device, or 
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entering a personal identification number into the peripheral. At step 540, the 
modification to the workflow is accepted. Step 540 may include the user 
entering input to the multifunction peripheral using a touch screen, a keyboard, 
or perhaps by marking on a bar-coded, printed document such as document 
5 1 30 of Figure 1 . At step 550, the modification is inserted into the workflow at the 
multifunction peripheral. 

The method continues at step 560. in which the modification and the 
workflow are saved in a storage device. In step 560, the actual modification 
may include adding a task to the workflow, adding user input to one or more of 

10 the multifunction peripherals that perform the workflow, and so forth. These 
inputs may be made in response to the multifunction peripheral printing a 
document, the user entering information onto the printed document, and then 
scanning the document into the peripheral. 

In some embodiments of the invention, a method of automating a 

15 workflow may include only the steps of transmitting, to a multifunction 

peripheral, information that identifies the name and a present state of the 
workflow at the multifunction peripheral (step 510), the multifunction peripheral 
accepting, by way of a user input, a modification to the workflow (step 540), and 
the multifunction peripheral inserting the modification into the workflow step 

20 (550). 

Figure 7 is a flowchart for a method for modifying a workflow using a 
multifunction peripheral according to an embodiment of the invention. The 
multifunction peripheral Figure 2 is suitable for performing the method of Figure 
7. The method of Figure 7 begins at step 600, in which the multifunction 

25 peripheral receives an input that identifies the user. In step 600, the input may 
include receiving a password, a personal identification number, a fingerprint or 
thumbprint, or receiving other information that identifies and authenticates the 
user. At step 610, a list of workflow tasks is received from a communications 
network, such as network 125 of Figure 1. 

30 At step 620, a list of workflows associated with the user is presented, 

perhaps by way of a display located on the peripheral. In step 630 at least 
some of the workflow tasks are presented to the user by way of a user interface. 
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At step 640, the peripheral accepts a modification to the workflow by way of the 
user interface. In response to receiving the modification, the peripheral inserts 
the modification into the workflow at step 650. At step 660, the peripheral saves 
the modification and the workflow in a memory. At step 670, workflow tasks, 
5 including the modification, are transmitted to a second multifunction peripheral. 
In some embodiments of the invention, only a subset of the steps of 
Figure 7 may be necessary. For example, some embodiments of the invention 
may include a method for modifying a workflow in a multifunction peripheral that 
includes receiving a list of workflow tasks from a communications network (610), 

10 presenting at least some of the workflow tasks to a user via a user interface 
(630), accepting a modification to the workflow via the user interface (640), 
inserting the modification into the workflow (650). 

In conclusion, while the present invention has been particularly shown 
and described with reference to the foregoing preferred and alternative 

15 embodiments, those skilled in the art will understand that many variations may 
be made therein without departing from the spirit and scope of the invention as 
defined in the following claims. This description of the invention should be 
understood to include the novel and non-obvious combinations of elements 
described herein, and claims may be presented in this or a later application to 

20 any novel and non-obvious combination of these elements. The foregoing 

embodiments are illustrative, and no single feature or element is essential to all 
possible combinations that may be claimed in this or a later application. Where 
the claims recite "a" or "a first" element or the equivalent thereof, such claims 
should be understood to include incorporation of one or more such elements, 

25 neither requiring nor excluding two or more such elements. 



What is claimed is: 



